Jarzynski equality for the transitions between nonequilibrium steady states 
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Jarzynski equality [Phys. Rev. E 56, 5018 (1997)], which has been considered to be vahd for 
the transitions between equihbrium states, is found to be applicable to the transitions between 
nonequilibrium stationary states satisfying certain conditions. Also numerical results confirm its 
validity. Its relevance for nonequilibrium thermodynamics of the operational formalism is discussed. 
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The framework of nonequilibrium thermodynamics has been sought by many authors in order to treat various 
nonequilibrium systems such as chemical reactions, transport processes in solids, moleculer motors, etc. Insofar, all 
these attempts seem to be based on the fluid-dynamical approaches, which mostly has the assumption of local equilib- 
rium at its starting point. Recently, Oono and Paniconi O] present a different type of nonequilibrium thermodynamics 
whose framework corresponds to equilibrium thermodynamics. The unique feature of their work lies in the fact that 
it is a set of laws concerning the operation from outside, as well as equilibrium thermodynamics. We refer their 
theory as the operational formalism. This formalism is so important that the concept of entropy in equilibrium ther- 
modynamics is introduced concerning with the adiabatic operation |3| . The relation between dynamical entropy and 
thermodynamic entropy is also discussed from this viewpoint Hence it is interesting to construct nonequilibrium 
thermodynamics from the operational point of view, apart from the existing fluid-dynamical approach. 

Operation by outside can cause energy exchange between the system and the external operator. In equilibrium 
thermodynamics, there is a principle of the minimum work for the system in the isothermal environment; 

AF < (W), (1) 

where AF denotes the free energy difference between the initial state and the final state of the system, and W denotes 
the work done by the external operator. The average of a physical quantity / is written as (/), as usual. Note that 
the sign of W is positive when the work is performed on the system. The equality holds when and only when the 
process is reversible. Jarzynski recently proposed the intriguing equality for the finite time transition between the 
equilibrium states |^; 

exp(-/3AF) = {exp{-pW)), (2) 

where (3 denotes the inverse temperature. Crooks gives another intriguing derivation of Eq. ^ using the fiuctuation 
theorem Q. This equality is confirmed to be valid in the finite time transition between equilibrium states. In this 
Rapid Communication, however, we show that Eq. (||) is indeed applicable to the finite time transition between 
nonequilibrium steady states which satisfy certain conditions. The derivation is given below by roughly following Ref. 

i- . 

Consider the system with the following Hamiltonian; 

H = Ho{p)+H{x;a)^xF{t), (3) 

where a is a parameter, and F(t) denotes the purturbative driving force which may be responsible for the nonequi- 
librium situation, and Hq{p) is independent of time. The external agent manipulates the system by varying the 
parameter a. The system may be in contact with a heat bath or several heat baths of different temperatures. In any 
cases, we describe the dynamics of the system by the stochastic process in the phase space spanned by x and p. We 
introduce the probability distribution function f{T,t) and the transition probability P{T,t\T' ,t'), where F denotes 
both X and p, to get 

/(F, t) = J dF'P(F, t|F', t')f{T', t'). (4) 



This leads to 



where 



g/(r,t) 

dt 



= I dx'R{r\T':,t)f{T',t), (5) 
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RiT\r';t)= lun + M^' - PjT ,t\T' ,t) ^ 

^ I ' ^ At->+0 At ' 

The dynamics of our nonequilibrium system is described by Eq. (^) together with the initial condition. Then we make 
an important assumption that the steady state of our system is characterized by the following distribution function; 

fsteadv(r;a) cx ^{x,p) e-Kp[-f3H{x; a)], (7) 

where is an arbitrary function of x and p, and /3 is a parameter that should be regarded as the effective 

inverse temperature. In other words, we confine the theory to the systems whose stationary distribution functions are 
represented by Eq. (0). By the definition of the stationary state, Eq. (||) leads to; 



dfst eady 



dV R{T\r' ■,t)^{x' ,p') exp[-(3H{x' ; a)] =0. (8) 



dt 

Our goal is to obtain the steady state version of Eq. (^; 

(exp(-^M^))=exp(-MF), (9) 

while the meaning of AF is unclear at this point. Note that P is identical to the one appearing in the distribution 
function Eq. (|^). Adopting the path- integral expression, we write; 

(eM-PW))^ j VT{t)eM~PW)V[V{t)l (10) 

where 7'[r(t)] is a probability distribution functional of the path T{t) in the phase space. The work done to the system 
is defined as ||^ 

W = / dta )-^. (11) 

} da 

We manipulate the system by changing the value of a from a(0) to ol[T). 

Then we discretize time duration of the operation [0, T] as (io, ^i, • • ■ , tn), and write T{ti) as Ti and T /N as At, 
respectively. As a result of the discretization, the distribution functional 7^[r(i)] is represented in terms of transition 
probability as follows; 

7'[r(<)] = Pjv(rAr|rAr_i)-.-Pi(ri|ro)/o(ro), (12) 



where /o(ro) denotes the initial probability distribution function. Similarly, Eq. (11) becomes 

N-l 

W^Y. ^H,+i{x,), (13) 

1=0 

where 

5H.i+i{xi) = H{xi\ai+i) - H{xi;ai). (14) 



Due to Eqs. (|1J) and (|13|), Eq. (|0|) is rewritten as 

N 

{exp{-pw)) = [H / dr,]Pjv(rjvirjv-i)e-^'^"(^"-^'---Fi(ri|ro)e-^^^^(-«)/o(ro). (15) 

The integrals on the right-side of Eq. (|l5| ) are represented by the following iteration. 

ffz+i(r) = ydr,p,+i(r|r,)e-'^^^'+^(^')<?,(r,), (16) 

where 

go{T) = /o(r), (17) 

(exp(-^W^)} = f gN{r)dr. (18) 
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By taking the first order terms of At, we have 



p,+i(r|r,) - ,5(r - r,) + Aii?,(r|r,) (19) 

g-/35i/. + i(..) = (20) 

Substituting Eqs. ( jl^ ) and (20) into the recursive relation Eq. (|l^), and taking the hmit At 0, we get 



This equation gives 



^^ = -/3a^^^ff(r,t)+ / dr'i?(r|r';t).9(r',t). (21) 



.g(r,t) cx <S>{x,p)exp[~PH{x;am, (22) 



noting that the second term of the right-hand side of Eq. ( pT]) vanishes by Eq. (||). Since Eq. ( |l7|) teUs us that g{T, 0) 
is identical to the initial probability distribution function fo (F) , the right-side of Eq. ( p2[ ) must have an appropriate 
normalization factor; 

g(r, t) = eM-m^; (23) 

where 

Zq^ J dr^{x,p)exp[-l3H{x;a{0))]. (24) 
From Eq. ([l^), we finally obtain the desired quantity; 

{exp{-pW)) = J dF.g(F,T) = ^, (25) 

where 

Zt = J dr^{x,p)exp[-PH{x;a{T))]. (26) 

Note that Zq and Zj- depend on only the value of a{0) and a{T), respectively, so that they are the state variables. 
Namely, the quantity {exp{— f3W)) does not depend on the transition process but depend only on the initial and the 
final states. Furthermore, if we define the free energy by 

F=-l3-HogZ, (27) 

Eq. ( p5| ) gives our goal Eq. (|9|), which is rewritten as; 

AF = log[(exp(-/3W))]. (28) 

This finishes the derivations of the steady state version of Jarzynski equality Eq. (^. In this derivation, the restriction 
on the stationary distribution function, Eq. (^, is imposed. It is quite unknown at this point that the Jarzynski 
equality holds for the system whose stationary distribution function does not satisfy the condition. Hereafter we check 
the validity of the results by numerical simulations on some concrete models. 

We consider two examples. First we treat the uniform temperature system whose Hamiltonian is given by 

H = y -f -^x^ -a;Asin(wt). (29) 

This is one of the simplest models of the nonequilibrium steady state driven by external force. By changing fc(t), 
we can put work onto the nonequilibrium system. Although the sinusoidal force performs work to the system, its 
contribution is a stationary dissipation which characterizes nonequilibrium states; following Ref. |Q, we call the work 
which stationarily dissipates " house-keeping work" . We do not count its contribution into the work. 
We employ the Langevin dynamics as a model of the heat bath; 

x + jx + k{t)x = Asm{ujt)+^{t), (30) 
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where ^(i) is the Gaussian white noise satisfying 



m) = 0, mm) - 2jr's{t - f). 



(31) 



The control parameter k{t) is changed from 1/4 to 1 as 



3t. 



(32) 



where T denotes the time duration of the operation. 

Let us discuss the statistical property of the stationary state. The model Eq. ( ^0| ) leads to a time-dependent 
Kramers equation which yields time-dependent distributions, if the forcing period 2t: /oj is longer than the relaxation 
time of the system. However, since the operation process is much slower than the forcing period, we average out 
the sinusoidal motion to get the stationary distribution. If the forcing period becomes comparable to the relaxation 
time, the response of the system cannot follow the forcing so that the distribution functions become Gibbsian in the 
high-frequency limit I/ijj — > 0. Here we choose the parameter such that the relaxation time of the position ^ ^ 
is longer than the forcing period, and the one of the momentum Tp ~ is shorter than the forcing period, i.e. 
< 2tt/uj < 7. We can expect that the distribution of the position x(a;) becomes Gibbsian and the one of the 



momentum 7r(p) is non-Gibbsian in this parameter range. The obtained x(a;) and 7r(p) are shown in Fig. 
can see that our expectation is realized; 



where we 



/(F; k) oc exp[-/3A:y]7ro(p). 



(33) 



Note that this satisfies the condition of Eq. (|^). Following Eq. (p7[), AF is calculated as (3~^ lo g 2 for this process. 
Then we check if Eq. ( [2^ ) holds. Since the distribution function is given by Eq. (|3^), f3 in Eq. ( p8|) corresponds to 
f3. The quantity to be forcused here, —jS^^ \og{exp[— PW]) , are shown in Fig. together with (W). As is clearly seen, 
while (W) changes its value depending on T, \og{exp[— f3W]) is an invariant with respect to the operation time 

T, which has been proved to be a state variable. As T gets larger, (W) seems to converge to a finite value, which is 
identical to log(exp[— we can regard this quantity as AF. These facts clearly indicate the validity of our 

main result. 

On the other hand, by tuning parameters, we can get different steady states whose distribution functions do not 
satisfy Eq. (^. In those cases, we found that our equlity no longer holds. However the principle of the minimum 
work still seems to be valid. 

Second, we consider the system in contact with two heat baths of different temperatures. The model we treat here 
is two Brownian particles coupled via the linear interacting potential. The Hamiltonian of the systems is; 



9 
Pi 



P2 



And the dynamics is written as; 



it + -fix + k{t)ix - y) = Ci(0> 
Again ^i{t) and £,2{t) are the Gaussian white noise; 

= 0, iUmAt')) = ^^^P^S,,S{t - t'), 

where 

" 10. (*^j) 

This may be the simplest heat conduction system, which is of course in nonequilibrium. 
intensively studied by Sekimoto H, and was found to have the following distribution; 



fsteadyO^; k) OC exp[-/3/c 



(x - yf 



I exp[-/3 



Pi + P2 1 



(34) 



(35) 
(36) 



(37) 



(38) 



This system has been 



(39) 



where 
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P = /31/32- (40) 

71 Pi + 72 /?2 

The steady state of the system hence satisfies the condition of Eq. (^). We again control the parameter k{t) as given 
in Eq. (32) and check if Jarzynski equahty holds. With the knowledge on the distribution function, AF is calculated 
to be (3 log 2 again. The numerical result using (3 of Eq. (^) is shown in Fig. . It is clear that Jarzynski equality 
is also valid in this heat conducting systems. 

In this Rapid Communication, we derive the steady state version of Jarzynski equality and reconfirm its validity by 
numerical simulations. The condition in which the equality holds is that the statinary distribution function is given 
by Eq. (|^). Note that the principle of the minimum work immediately follows Eq. (p8[). Namely, the principle of 
minimum work is also valid for the transition between nonequilibrium steady states. 

However, the equality has clear limitation on its application. The condition Eq. (0) is rather crucial that it 
cannot describe the steady state of the system where the temperature depends on the position; e.g. the Brownian 
particle in the nonuniform temperature environment |p^ . It is unclear to what extent Eq. (|^) is satisfied in various 
nonequilibrium systems. 

Another open question is the definition of the free energy in nonequilibrium systems. As we have seen in the 
numerical simulations above, Eq. ( p7| ) seems to be valid in the system satisfying Eq. (^ regardless of the statistical 
property of the momentum space. However, in more general systems, the definition of the nonequilibrium free energy 
as well as entropy is still unclear, although it may appear as the minimum work as is stated in Eq. (Q). The broader 
application and the further development of the framework stated in Ref. 1^ must be fruitful for nonequilibrium 
thermodynamics and should be the main focus of the future problem. 

The author thanks S. Sasa for helpful discussions and his critical reading of the manuscript. Discussions with S. 
Takesue, H. Nakazato, and Y. Yamanaka arc also gratefully acknowledged. 
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FIG. 1. The steady state distribution functions in the configuration space x(^) (diamonds) and in the momentum space 
n{p) (solid line). Dashed line represents the Gaussian distribution corresponding to exp[~l3kx'^ /2]. Parameters are set as fc = 1, 
/3 = 1, 7 = 2, A = 2, and a; = 3. 



FIG. 2. Averaged work and the free energy of the two examples in the text. Plots on the down side are for the sine 
forcing system. Blanked diamonds and circles denote (W) and —fi~^ log(exp[— /3VF]) , respectively. All the parameters are 
the same as Fig. 1. Plots on the up side are for the heat conducting system. Filled diamonds and circles denote (yV) and 
~j3^^ log(exp[— /3IF]) , respectively. We set the parameters to be 71 = 72 = 1, Pi ~ 0.5, and {32 = 1. Dashed lines denote the 
free energy difference calculated from the stationary distribution functions. 
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